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?H ' Abstract. The so-called Simpson's "paradox", or Yule-Simpson (YS) effect, 

^ ' occurs in classical statistics when the correlations that are present among different 

sets of samples are reversed if the sets are combined together, thus ignoring one 
or more lurking variables. Here we illustrate the occurrence of two analogue 
VO ■ effects in quantum measurements. The first, which we term quantum- classical 

YS effect, may occur with quantum limited measurements and with lurking 
variables coming from the mixing of states, whereas the second, here referred 
to as quantum- quantum YS effect, may take place when coherent superpositions 
f | , of quantum states are allowed. By analyzing quantum measurements on low 

O |. dimensional systems (qubits and qutrits), we show that the two effects may occur 

independently, and that the quantum-quantum YS effect is more likely to occur 
>-H ' than the corresponding quantum-classical one. We also found that there exist 

f—i ' classes of superposition states for which the quantum-classical YS effect cannot 

r^ ^ occur for any measurement and, at the same time, the quantum-quantum YS 

__i^, effect takes place in a consistent fraction of the possible measurement settings. 

The occurrence of the effect in the presence of partial coherence is discussed as 
well as its possible implications for quantum hypothesis testing. 

(N 
> 

"^ PACS numbers: 03.65.- 

1. Introduction 

rn ■ 

f^ . In classical statistics, the so-called Simpson's "paradox", also referred to as the Yule- 

O^ ' Simpson effect [D [21 13]! occurs when the correlations observed in different groups 

are reversed when the groups are combined together. The typical examples come 

from social- or medical-science [H [5j [6l [7]: Suppose you are given two samples, A 

ij . and B, on which the rates of success of two events, say, the success of two different 

i*^ ' therapies or of two ways of applying for a job, are given by p^ and q^ respectively, with 

C^ . Pa < Qb- The rates of success express the degree of correlations between the events 

under consideration and the characteristic features of the samples A and B. Then, 

it may occur that by splitting the initial samples in groups, say Ai,A2 and Bi,B2, 

according to the the value of a certain lurking variable (say, gender, age, geographical 

localization,..) the ordering of the rates of success, and thus of the correlations, is 

reversed, in formula Pai > Qbi and Pa2 > Qb2- As for example, a certain therapy may 

appear good for women and good for men, but bad for people [7] . 

Actually, there is no mathematical paradox: The YS effect arises from a hidden 
correlation, and it may be explained in terms of the relative weights of the groups 
Ai , A2 and -Bi , i?2 , due to different sizes of the samples in the groups Aj and Bj [5] [5] . 
An example illustrating the point is reported in the appendix. On the other hand, the 
practical consequences of the effect are indeed counterintuitive for decision making, 
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since the aggregated data and the partitioned ones are, in fact, suggesting opposite 
strategies [THl E] • Other examples arises in game theory, where it may be shown that 
two losing strategies may be randomly combined to form a winning one |12l I13[ 1141 115] 
realizing, in fact, a variation of the YS effect. From the operational point of view there 
is an additional reason for the emergence of the YS effect, which may summarized by 
saying the two events are incompatible: once a therapy has been administered, or 
an application has been submitted, there is no way to determine the outcome of the 
other options for the same individual [16] . In other words, there is no way to assign 
a definite meaning to the rate of success of the two events simultaneously. Loosely 
speaking, this fact suggests that other incompatibilities [17] , as those arising from the 
quantum mechanical description of measurements, may play a role for the occurrence 
of the YS effect. 

In this communication, we address this possibility in details and investigate the 
occurrence of the YS effect in systems subjected to the laws of quantum mechanics. 
In particular, we analyze the role of mixing and superposition of quantum states, and 
illustrate the occurrence of two kinds of YS effects in quantum measurements. The 
first, which we term quantum- classical YS effect (QCYS), may occur with quantum 
limited measurements and mixing of states, whereas the second, here referred to as 
quantum- quantum YS effect (QQYS), may take place when superpositions of quantum 
states are allowed. We describe both effects in some details, prove that they may occur 
independently, and present a class of states for which QQYS effect occurs when, for 
the same values of the involved parameters, the QCYS one does not. 

2. The quantum-classical YS effect 

Let us consider two quantum tests, i.e. two binary probability operator-valued 
measures (POVMs) A = {11^,1 — 11^} and B = {11^,1 — 11^} aimed at describing the 
occurrence of certain events A and B. Given a quantum state {ip), the expectation 
value (iplUjlij;) returns the probability of the event j — A,B on the state li/i), and thus 
represents the correlations between the occurrence of the event and the preparation 
of the system. 

We assume that the system under investigation may be prepared in two possible 
states Itpj), j = 1,2 and that the event A is more likely to happen than the event B 
for both preparations, i.e. 

Pj = (V'jIHaIV'j) > qj = (V'jinBlV'j) • 

We have the Yule-Simpson effect whenever it occurs that for some choice of the 
mixing parameters (which play the role of relative weights due to different sample 
sizes) the event B become more probable for the system prepared in mixed state 
g/3 = cos^ /3|'!/'i)('0i| + sin /3 1 "02) ("02 1 rather than for the system prepared in mixed 
state Qa = cos^ altl^i) {t/^i] -\- sin^ a\ip2} {ip2\ i-e. that 

p = Tr[ga'nA] < q = T^r[gpIlB] (1) 

where Tr[£i„ n^] = cos^ api-|-sin^ ap2 and Tr[p^ 11^] = cos^ /3 gi -I- sin^ /3 ^2 (see Table 
1 for a summary) . The condition p < q may be written as 

cos^ P {qi - q2) > cos^ a {pi - P2) + {p2 - 92) ■ (2) 
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and it is satisfied by cos^ /3 ^ T ii pi — p2 ^ and qi — q2 ^ [IH] , where 
T = a cos^a + b, a = {pi - P2)/{qi - 92) and b ^ {p2 ~ '?2)/('?i - '72)- We refer 
to tliis form of the Yule-Simpson effect as to quantum-classical Simpson's paradox 
since it happens in quantum-limited measurements, however with the lurking variable 
coming from the classical mixing of two quantum states. 
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Table 1. The quantum-classical Yule-Simpson effect 

As mentioned in the introduction, unequal mixing of the two states is needed for 
the occurrence of the YS effect. Indeed, by putting cos^ a = cos^ (i — \ in Eq. ([5]), 
one obtains Qa = Qp, and thus the condition ■^{pi + P2) < ^(91 + 92)1 which is never 
satisfied within the initial assumptions pj > qj . 

2.1. The QCYS effect in quantum hypothesis testing 

In this section we provide an example, illustrating the realization of the QCYS effect 
in a decision problem involving quantum measurements and a finite number of runs. 

Suppose that you are given a black box, which may implement two possible 
dichotomic measurements A — {Ha , I — H 4 } and B — {Hb , I — Hb } on a given system, 
and you have to infer which measurement has been performed on the basis of the 
results of the measurement. To this aim, you may probe the measuring box M times, 
and in each run you have at disposal two possible preparations of the system, say 
\^pj), j = 1,2. In order to have a specific example in mind we may consider the case 
of a Sten-Gerlach apparatus, which may realize the measurement of a spin component 
along a given direction 9, i.e. II^i = |0)6(e(0|, or along a slightly tilted one 9', i.e. 
He — \O)0'0'{O\. We have access to a pair of possible preparations of the spin system, 
and we have to infer which component has been actually measured on the basis of the 
number of, say, upper spots recorded after M — Mi + M2 repeated measurements, 
where Mj is the number of runs where the system was prepared in the state |V'j)- 

If we know which preparation \%l)j) is used in each run then, using the notation 
of the previous section and assuming pj > qj, we would always infer that the box 
is performing measurement A, independently on the values of Mi and M2. On the 
other hand, if we ignore the information about which state has been sent to the box 
in each run, i.e. we aggregate spots, then we may reach the opposite conclusion, 
depending on the relative weight M1/M2 of the samples. More explicitly, we have 
the QCYS effect whenever using Mi or M[ times the probe state \4'i), the quantities 
cos^ a = Mi/M and cos^ /3 = M[/M satisfy Eq. ^. As in the classical case there is 
no mathematical paradox: still the aggregated data and the partitioned ones may, in 
fact, suggest opposite conclusions. 

3. The quantum-quantum YS effect 

Here we address situations where the lurking variables are coming from the coherent 
superposition of quantum states, rather than from their mixing, and discuss the 
occurrence of the corresponding quantum- quantum Simpson's paradox. 
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Let us consider a situation where the system under investigation, besides the 
states {tpj), j ~ 1,2, may be prepared in any superposition of the form 
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(3) 



where A^^ = 1 + k^ cos(0^ — (/3K)sin27 is the normahzation, and n^e'^^'^ = (V'il'02) 
is the overlap between the two initial preparations. We assume, as in the previous 
case, that pj > Qj j = 1,2. Then, the YS effect occurs whenever, for two different 
superpositions 1-00) and {ipp), it happens that 



(V'aln^lV'a) 
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(4) 



where 



P = [cos api + sin ap2 + Ka cos{(j)a — ^a) sin 2a] 

p + Ka cos{(f>a ~ </?a) sin 2a 
1 + K^ cos{(f)a — ^k) sin 2a 

Q = — [cos^ l3qi+ sin^ (iq2 + Kb cos((/)/3 - ipe) sin 2/3] 

q + Kb cos(0/3 — lPb ) sin 2/3 
1 + K^ cos((/)/3 - ipk) sin 2/3 



(5) 



with (V'i|nj#2) 



-iipj 



j — A,B (see Table 2 for a summary). In the following 



we will investigate whether the two effects may occur independently (i.e. p < q when 
P > Q, and viceversa) and, in particular, whether or not the quantum-quantum Yule- 
Simpson effect may occur when, for the same values of the involved parameters, the 
quantum-classical effect does not. 
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Table 2. The quantum-quantum Yulc-Simpson effect 



4. Results for low dimensional systems 



In order to gain a quantitative insight into both effects let us start by focusing 
on bidimensional systems (qubits). In this case we may write the initial states as 
IV-i) = cos 6lj 1 0) + e*sin6'j|l), j = 1,2 where {|0), |1)} is a basis for the Hilbert 
space, and the POVMs as IIj ~ ^{gj + rj ■ cr), j — A,B, where r = {ri,r2,r3}, 
and (T = {(Ti, (72, (73} are Pauli matrices. The constraint of positivity for the II^'s is 
expressed by the conditions \rj\ < Oj < 2 — \rj\. Projective measurements are those 
individuated by the relations \rj\ ~ aj — 1. 

Before going to the general case, let us consider the specific example where A 
and B are mutually exclusive events. Classically, there is no YS effect in this case, 
since no lurking variable may change the correlations. Quantum mechanically, the two 
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mutually exclusive events are described by projective measurements on two orthogonal 
states. For qubits they span the entire Hilbert space, i.e. 11^+11^ = I. As a 
consequence, we have qj = 1 — pj and, in turn, p > q ii pj > qj, i.e no QCYS effect. 
On the other hand, by looking at Eqs. (|1]) and (O, one sees that QQYS effect takes 
place whenever we have ^ < ^ for p > ^, e.g. upon choosing H^ = |0)(0| and 
n^ = |1}(1|, for 01 = 0,92 = 7r/4, 0i = 02 = 0, a = 7r/2, /3 = 7r/4, and 0„ = 0^ = tt. 
More generally, the occurrence of QCYS and QQYS may be investigated in terms 
of the four + eight + four parameters describing the initial states \ipj), j = 1,2, the 
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A,B, and the lurking variables a,f3,( 



In Fig. [T] we report 



results for random states and measurements, generated to satisfy the constraints 
Pj > Qji i — li2, and for random lurking variables. In particular, we show the 
ratio P/Q as a function of the ratio p/q. The square region p/q S (0, 1) x P/Q G (0, 1) 
corresponds to the occurrence of both the QC and QQ YS effects, whereas the 
rectangular regions (0,1) x [l,oo) and [l,oo) x (0,1) correspond to cases when 
solely the QC effect, or the QQ one, takes place, respectively. Finally, the region 
[l,oo) X [l,oo) corresponds to situations when we have no YS effects. On the left, 
we show the results for random states and measurements, and for random lurking 
variables a,/3 G [0,7r/2], 0a, 0^ G [0,27r], whereas on the right we consider only 
situations for which a ~ (3 = 7r/4. 
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Figure 1. (Color online) Quantum-quantum YS effect vs quantum-classical YS 
effect for qubit systems. Left: the ratio P/Q as a function oi p/q for 10'' randomly 
generated sets of states, measurements, and lurking variables. Right: the same 
plot for fixed values of the mixing parameters a = p = it/A:. 



As it is apparent from the left plot, the two effects may occur independently, 
i.e. we may have p < q when P > Q, and viceversa. For random settings, i.e. 
random states, measurements and lurking variables, the QQYS effect is more likely to 
occur than the corresponding CCYS effect. Upon generating a sample of 10"* random 
settings, we found QCYS effect without the QQYS one in about 0.97% of cases, just 
the reverse in about 10.9% of cases, and both effects in about 1.7% of cases. The right 
plot refers to random initial states and measurements, and to lurking variables with 
equal mixing parameters cos^ a = cos^ /? = 5- In this case, as mentioned before, the 
QCYS effect cannot occur for any measurement. On the other hand, upon considering 
quantum superpositions, we have that the QQYS effect occurs for a consistent fraction 
of the possible settings (about 14%). If we consider only projective measurements. 
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6 



the rates of occurrence of both the YS effects increases, but the overaU picture is 
not quaUtatively modified. Similar results are also obtained by considering three- 
dimensional quantum systems (qutrits). 

4.1. Partial coherence and the generalized QQYS effect 

Let us now assume that besides the complete mixture g-y, and the coherent 
superposition \^-y), the system may be also prepared in partially coherent 
superpositions of the two initial states \ijjj), i-e. we consider the general class of 
states g\^ = X\ipj) {iIj^I + (1 — X)g^, where 7 = a, /3, < A < 1. The family g\ry 
continuously connects the coherent superposition to the complete mixture, and we 
now address the occurrence of the corresponding generalized QQYS effect, which 
takes place, assuming again pj > Qj, j = 1,2, when we have P\ < Q\, where 
Px = Tr [g^^ n^] = AP + (1 - X)p, Q^ = Tr [g^^ H^] = XQ + {I - X)q. Using 
these expressions and introducing the threshold value 
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one easily see that the QQYS effect persists in the range A £ (Ath, 1) if P - 
or A e (0, Ath) iip-q<P-Q. 
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Figure 2. (Color online) Generalized quantum-quantum YS effect vs quantum- 
elassical YS effect for qubit systems. The ratio P\/Qx is shown as a function oip/q 
for 10^ randomly generated sets of states, measurements, and lurking variables. 
From left to right: A = 0.1, 0.5, 0.9 respectively. 

The transition from the QC to the QQ effect is illustrated in Fig. [21 where we 
show the ratio P\/Q\ as a function of the ratio p/q for 10"' sets of randomly generated 
states, measurements and lurking variables (as in Fig. [T]), and for different values of 
A. 



5. Conclusions 



The Yule-Simpson is a paradigmatic paradoxical effect occurring in data aggregation 
in complex systems, and found applications in the physical description of, e.g. social 
processes [19], complex dynamics [20], and game theory [21 . In this communication, 
we have illustrated the occurrence of the YS effect in quantum measurements, where 
the lurking variables are coming either from the mixing or the superposition of 
quantum states. By analyzing low dimensional systems, we have found that the 
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two effects may occur independently, and that the quantum-quantum YS effect is 
more likely to occur than the corresponding quantum-classical one for the same set 
of states and measurements. We have also discussed an example, illustrating the 
occurence of the quantum-classical YS effect in a decision problem involving quantum 
measurements. 

Appendix A. An example of YS effect: sex bias in graduate admissions 

One of the best known real life examples of Simpson's paradox occurred when the 
University of California, Berkeley was sued for bias against women who had applied 
for admission to graduate schools there [22]. The admission figures for the fall of 
1973 showed that men applying were more likely than women to be admitted, and 
the difference was so large that it was unlikely to be due to statistical fluctuations. 
On the other hand, when examining the individual departments, it appeared that 
no department was significantly biased against women. In fact, most departments 
had a small but statistically significant bias in favor of women [3] . The explanation 
of the "paradox" is relatively simple: the women tended to apply to competitive 
departments, with low rates of admission even among qualified applicants (such 
as in the English Department), whereas men tended to apply to less-competitive 
departments with high rates of admission among the qualified applicants (such as 
in engineering and chemistry) , and overall this results in a smaller fraction of women 
admitted in total. 
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